Online learning via dynamic reranking for Computer Assisted Translation

New techniques for online adaptation in computer assisted translation are explored and compared to previously existing approaches. Under the online adaptation paradigm, the translation system needs to adapt itself to real-world changing scenarios, where training and tuning may only take place once, when the system is set-up for the first time. For this purpose, post-edit information, as described by a given quality measure, is used as valuable feedback within a dynamic reranking algorithm. Two possible approaches are presented and evaluated. The first one relies on the well-known perceptron algorithm, whereas the second one is a novel approach using the Ridge regression in order to compute the optimum scaling factors within a state-of-the-art SMT system. Experimental results show that such algorithms are able to improve translation quality by learning from the errors produced by the system on a sentence-by-sentence basis.This paper is based upon work supported by the EC (FEDER/FSE) and the Spanish MICINN under projects MIPRCV “Consolider Ingenio 2010” (CSD2007-00018) and iTrans2 (TIN2009-14511). Also supported by the Spanish MITyC under the erudito.com (TSI-020110-2009-439) project, by the Generalitat Valenciana under grant Prometeo/2009/014 and scholarship GV/2010/067 and by the UPV under grant 20091027Martínez Gómez, P.; Sanchis Trilles, G.; Casacuberta Nolla, F. (2011). Online learning via dynamic reranking for Computer Assisted Translation. En Computational Linguistics and Intelligent Text Processing. Springer Verlag (Germany). 6609:93-105. https://doi.org/10.1007/978-3-642-19437-5_8S931056609Brown, P., Pietra, S.D., Pietra, V.D., Mercer, R.: The mathematics of machine translation. In: Computational Linguistics, vol. 19, pp. 263–311 (1993)Zens, R., Och, F.J., Ney, H.: Phrase-based statistical machine translation. In: Jarke, M., Koehler, J., Lakemeyer, G. (eds.) KI 2002. LNCS (LNAI), vol. 2479, pp. 18–32. Springer, Heidelberg (2002)Koehn, P., Och, F.J., Marcu, D.: Statistical phrase-based translation. In: Proc. HLT/NAACL 2003, pp. 48–54 (2003)Callison-Burch, C., Fordyce, C., Koehn, P., Monz, C., Schroeder, J.: (meta-) evaluation of machine translation. In: Proc. of the Workshop on SMT. ACL, pp. 136–158 (2007)Papineni, K., Roukos, S., Ward, T.: Maximum likelihood and discriminative training of direct translation models. In: Proc. of ICASSP 1988, pp. 189–192 (1998)Och, F., Ney, H.: Discriminative training and maximum entropy models for statistical machine translation. In: Proc. of the ACL 2002, pp. 295–302 (2002)Och, F., Zens, R., Ney, H.: Efficient search for interactive statistical machine translation. In: Proc. of EACL 2003, pp. 387–393 (2003)Sanchis-Trilles, G., Casacuberta, F.: Log-linear weight optimisation via bayesian adaptation in statistical machine translation. In: Proceedings of COLING 2010, Beijing, China (2010)Callison-Burch, C., Bannard, C., Schroeder, J.: Improving statistical translation through editing. In: Proc. of 9th EAMT Workshop Broadening Horizons of Machine Translation and its Applications, Malta (2004)Barrachina, S., et al.: Statistical approaches to computer-assisted translation. Computational Linguistics 35, 3–28 (2009)Casacuberta, F., et al.: Human interaction for high quality machine translation. Communications of the ACM 52, 135–138 (2009)Ortiz-Martínez, D., García-Varea, I., Casacuberta, F.: Online learning for interactive statistical machine translation. In: Proceedings of NAACL HLT, Los Angeles (2010)España-Bonet, C., Màrquez, L.: Robust estimation of feature weights in statistical machine translation. In: 14th Annual Conference of the EAMT (2010)Reverberi, G., Szedmak, S., Cesa-Bianchi, N., et al.: Deliverable of package 4: Online learning algorithms for computer-assisted translation (2008)Crammer, K., Dekel, O., Keshet, J., Shalev-Shwartz, S., Singer, Y.: Online passive-aggressive algorithms. Journal of Machine Learning Research 7, 551–585 (2006)Snover, M., Dorr, B., Schwartz, R., Micciulla, L., Makhoul, J.: A study of translation edit rate with targeted human annotation. In: Proc. of AMTA, Cambridge, MA, USA (2006)Papineni, K., Roukos, S., Ward, T., Zhu, W.: Bleu: A method for automatic evaluation of machine translation. In: Proc. of ACL 2002 (2002)Rosenblatt, F.: The perceptron: A probabilistic model for information storage and organization in the brain. Psychological Review 65, 386–408 (1958)Collins, M.: Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms. In: EMNLP 2002, Philadelphia, PA, USA, pp. 1–8 (2002)Koehn, P.: Europarl: A parallel corpus for statistical machine translation. In: Proc. of the MT Summit X, pp. 79–86 (2005)Koehn, P., et al.: Moses: Open source toolkit for statistical machine translation. In: Proc. of the ACL Demo and Poster Sessions, Prague, Czech Republic, pp. 177–180 (2007)Och, F.: Minimum error rate training for statistical machine translation. In: Proc. of ACL 2003, pp. 160–167 (2003)Kneser, R., Ney, H.: Improved backing-off for m-gram language modeling. In: IEEE Int. Conf. on Acoustics, Speech and Signal Processing II, pp. 181–184 (1995)Stolcke, A.: SRILM – an extensible language modeling toolkit. In: Proc. of ICSLP 2002, pp. 901–904 (2002

Risk of Death from Cardiovascular Disease Associated with Low-level Arsenic Exposure Among Long-term Smokers in a US Population-based Study

High levels of arsenic exposure have been associated with increases in cardiovascular disease risk. However, studies of arsenic’s effects at lower exposure levels are limited and few prospective studies exist in the United States using long-term arsenic exposure biomarkers. We conducted a prospective analysis of the association between toenail arsenic and cardiovascular disease mortality using longitudinal data collected on 3939 participants in the New Hampshire Skin Cancer Study. Using Cox proportional hazard models adjusted for potential confounders, we estimated hazard ratios and 95% confidence intervals associated with the risk of death from any cardiovascular disease, ischemic heart disease, and stroke, in relation to natural-log transformed toenail arsenic concentrations. In this US population, although we observed no overall association, arsenic exposure measured from toenail clipping samples was related to an increased risk of ischemic heart disease mortality among long-term smokers (as reported at baseline), with increased hazard ratios among individuals with ≥ 31 total smoking years (HR: 1.52, 95% CI: 1.02, 2.27), ≥ 30 pack-years (HR: 1.66, 95% CI: 1.12, 2.45), and among current smokers (HR: 1.69, 95% CI: 1.04, 2.75). These results are consistent with evidence from more highly exposed populations suggesting a synergistic relationship between arsenic exposure and smoking on health outcomes and support a role for lower-level arsenic exposure in ischemic heart disease mortality

Non Melanoma Skin Cancer and Subsequent Cancer Risk

Introduction: Several studies have shown an increased risk of cancer after non melanoma skin cancers (NMSC) but the individual risk factors underlying this risk have not been elucidated, especially in relation to sun exposure and skin sensitivity to sunlight. Purpose: The aim of this study was to examine the individual risk factors associated with the development of subsequent cancers after non melanoma skin cancer. Methods: Participants in the population-based New Hampshire Skin Cancer Study provided detailed risk factor data, and subsequent cancers were identified via linkage with the state cancer registry. Deaths were identified via state and national death records. A Cox proportional hazard model was used to estimate risk of subsequent malignancies in NMSC patients versus controls and to assess the potential confounding effects of multiple risk factors on this risk. Results: Among 3584 participants, risk of a subsequent cancer (other than NMSC) was higher after basal cell carcinoma (BCC) (adjusted HR 1.40 [95% CI 1.15, 1.71]) than squamous cell carcinoma (SCC) (adjusted HR 1.18 [95% CI 0.95, 1.46]) compared to controls (adjusted for age, sex and current cigarette smoking). After SCC, risk was higher among those diagnosed before age 60 (HR 1.96 [95% CI 1.24, 3.12]). An over 3-fold risk of melanoma after SCC (HR 3.62; 95% CI 1.85, 7.11) and BCC (HR 3.28; 95% CI 1.66, 6.51) was observed, even after further adjustment for sun exposure-related factors and family history of skin cancer. In men, prostate cancer incidence was higher after BCC compared to controls (HR 1.64; 95% CI 1.10, 2.46). Conclusions: Our population-based study indicates an increased cancer risk after NMSC that cannot be fully explained by known cancer risk factors

Retrospective, matched case-control analysis of tickborne encephalitis vaccine effectiveness by booster interval, Switzerland 2006-2020

Objective: To estimate effectiveness of tickborne encephalitis (TBE) vaccination by time interval (<5, 5-10 and 10+years) postvaccination. Design: A retrospective, matched case-control study PARTICIPANTS: Cases-all adult (age 18-79) TBE cases in Switzerland reported via the national mandatory disease reporting surveillance system from 2006 to 2020 (final n=1868). Controls-community controls from a database of randomly selected adults (age 18-79) participating in a 2018 cross-sectional study of TBE vaccination in Switzerland (final n=4625). Primary outcome measures: For cases and controls, the number of TBE vaccine doses received and the time since last vaccination were determined. Individuals were classified as being 'unvaccinated' (0 doses), 'incomplete' (1-2 doses) or 'complete' (3+ doses). Individuals with 'complete' vaccination were further classified by time since the last dose was received (<5 years, 5-10 years or 10+ years). A conditional logistic regression model was used to calculate vaccine effectiveness (VE: 100 × [1-OR]) for each vaccination status category. Results: VE for incomplete vaccination was 76.8% (95% CI 69.0% to 82.6%). For complete vaccination, overall VE was 95.0% (95% CI 93.5% to 96.1%). When the most recent dose was received <5 years prior VE was 91.6% (95% CI 88.4% to 94.0%), 95.2% (95% CI 92.4% to 97.0%) when the most recent dose was received 5-10 years prior, and 98.5% (95% CI 96.8% to 99.2%) when the most recent dose was received 10+ years prior. Conclusions: That VE does not decrease among completely vaccinated individuals over 10+ years since last vaccination supports the longevity of the protective response following complete TBE vaccination. Our findings support the effectiveness of 10-year TBE booster intervals currently used in Switzerland. Keywords: Breakthrough Infection; Duration; Prevention; Protection; TBE

A prognostic score for non-small cell lung cancer resected after neoadjuvant therapy in comparison with the tumor-node-metastases classification and major pathological response.

Studies validating the prognostic accuracy of the tumor-node-metastases (TNM) classification in patients with lung cancer treated by neoadjuvant therapy are scarce. Tumor regression, particularly major pathological response (MPR), is an acknowledged prognostic factor in this setting. We aimed to validate a novel combined prognostic score. This retrospective single-center study was conducted on 117 consecutive patients with non-small cell lung cancer resected after neoadjuvant treatment at a Swiss University Cancer Center between 2000 and 2016. All cases were clinicopathologically re-evaluated. We assessed the prognostic performance of a novel prognostic score (PRSC) combining T-category, lymph node status, and MPR, in comparison with the eighth edition of the TNM classification (TNM8), the size adapted TNM8 as proposed by the International Association for the Study of Lung Cancer (IASLC) and MPR alone. The isolated ypT-category and the combined TNM8 stages accurately differentiated overall survival (OS, stage p = 0.004) and disease-free survival (DFS, stage p = 0.018). Tumor regression had a prognostic impact. Optimal cut-offs for MPR emerged as 65% for adenocarcinoma and 10% for non-adenocarcinoma and were statistically significant for survival (OS p = 0.006, DFS p &lt; 0.001). The PRSC differentiated between three prognostic groups (OS and DFS p &lt; 0.001), and was superior compared to the stratification using MPR alone or the TNM8 systems, visualized by lower Akaike (AIC) and Bayesian information criterion (BIC) values. In the multivariate analyses, stage III tumors (HR 4.956, p = 0.003), tumors without MPR (HR 2.432, p = 0.015), and PRSC high-risk tumors (HR 5.692, p &lt; 0.001) had significantly increased risks of occurring death. In conclusion, we support 65% as the optimal cut-off for MPR in adenocarcinomas. TNM8 and MPR were comparable regarding their prognostic significance. The novel prognostic score performed distinctly better regarding OS and DFS

Diet and Toenail Arsenic Concentrations in a New Hampshire Population with Arsenic-Containing Water

Background: Limited data exist on the contribution of dietary sources of arsenic to an individual\u27s total exposure, particularly in populations with exposure via drinking water. Here, the association between diet and toenail arsenic concentrations (a long-term biomarker of exposure) was evaluated for individuals with measured household tap water arsenic. Foods known to be high in arsenic, including rice and seafood, were of particular interest. Methods: Associations between toenail arsenic and consumption of 120 individual diet items were quantified using general linear models that also accounted for household tap water arsenic and potentially confounding factors (e.g., age, caloric intake, sex, smoking) (n = 852). As part of the analysis, we assessed whether associations between log-transformed toenail arsenic and each diet item differed between subjects with household drinking water arsenic concentrations \u3c1 μg/L versus ≥1 μg/L

A microbial-based cancer vaccine for induction of EGFRvIII-specific CD8+ T cells and anti-tumor immunity.

Dysregulated signaling via the epidermal growth factor receptor (EGFR)-family is believed to contribute to the progression of a diverse array of cancers. The most common variant of EGFR is EGFRvIII, which results from a consistent and tumor-specific in-frame deletion of exons 2-7 of the EGFR gene. This deletion generates a novel glycine at the junction and leads to constitutive ligand-independent activity. This junction forms a novel shared tumor neo-antigen with demonstrated immunogenicity in both mice and humans. A 21-amino acid peptide spanning the junctional region was selected, and then one or five copies of this 21-AA neo-peptide were incorporated into live-attenuated Listeria monocytogenes-based vaccine vector. These vaccine candidates demonstrated efficient secretion of the recombinant protein and potent induction of EGFRvIII-specific CD8+ T cells, which prevented growth of an EGFRvIII-expressing squamous cell carcinoma. These data demonstrate the potency of a novel cancer-specific vaccine candidate that can elicit EGFRvIII-specific cellular immunity, for the purpose of targeting EGFRvIII positive cancers that are resistant to conventional therapies

CD27 is required for protective lytic EBV antigen-specific CD8+ T-cell expansion

Primary immunodeficiencies in the costimulatory molecule CD27 and its ligand, CD70, predispose for pathologies of uncontrolled Epstein-Barr virus (EBV) infection in nearly all affected patients. We demonstrate that both depletion of CD27+ cells and antibody blocking of CD27 interaction with CD70 cause uncontrolled EBV infection in mice with reconstituted human immune system components. While overall CD8+ T-cell expansion and composition are unaltered after antibody blocking of CD27, only some EBV-specific CD8+ T-cell responses, exemplified by early lytic EBV antigen BMLF1-specific CD8+ T cells, are inhibited in their proliferation and killing of EBV-transformed B cells. This suggests that CD27 is not required for all CD8+ T-cell expansions and cytotoxicity but is required for a subset of CD8+ T-cell responses that protect us from EBV pathology

Intake of α-linolenic acid and other fatty acids in relation to the risk of bladder cancer: results from the New Hampshire case–control study

The role of dietary fat in bladder cancer aetiology is currently unclear due to few studies, equivocal findings and a lack of information on important dietary fatty acids. The aim of the present study was to investigate the association between the intake of major dietary fats and fatty acids and the risk of bladder cancer. A case–control study was conducted in New Hampshire, USA. Dietary data were collected from 322 cases and 239 controls, and OR and 95 % CI were calculated using unconditional logistic regression. Adjustment was made for potential confounders: sex, age, smoking status, pack-years smoked, cholesterol and energy intake. Statistically significant reduced odds of bladder cancer were observed for high intakes (highest quartile v. lowest quartile) of α-linolenic acid (ALA) (OR 0.26, 95% CI 0.10, 0.65; P for trend=0.01) and vegetable fat (OR 0.39, 95% CI 0.18, 0.86; P for trend=0.03). Borderline statistically significant reduced odds were detected for polyunsaturated fat (OR 0.43, 95% CI 0.19, 0.98; P for trend=0.07) and linoleic acid (OR 0.43, 95% CI 0.19, 0.96; P for trend=0.06). These fats and fatty acids were highly correlated and following adjustment for each other, the only potential inverse association to remain was for ALA. The present findings suggest that ALA may have a protective role against developing bladder cancer; however, further investigation and replication in other epidemiological studies are required. Future research should focus on the type, source and quantities of different dietary fatty acids consumed